word rank | frequency | word |
---|---|---|
1 | 5651 | וואס |
2 | 4846 | נישט |
3 | 4144 | האבן |
4 | 3883 | זיין |
5 | 3269 | אויף |
word rank | frequency | word |
---|---|---|
1 | 4147 | וועלכע |
2 | 3570 | געווען |
3 | 1253 | אנדערע |
4 | 1082 | מענטשן |
5 | 739 | זייערע |
word rank | frequency | word |
---|---|---|
1 | 830 | רעגירונג |
2 | 307 | געהייראט |
3 | 274 | היסטאריע |
4 | 226 | ספעציעלע |
5 | 218 | אנגערופן |
word rank | frequency | word |
---|---|---|
1 | 296 | אמעריקאנער |
2 | 142 | האלבערשטאם |
3 | 135 | מיליטערישע |
4 | 98 | איינציגסטע |
5 | 97 | אומגעקומען |
word rank | frequency | word |
---|---|---|
1 | 209 | איינוואוינער |
2 | 118 | איבערגענומען |
3 | 81 | אריינגערעכנט |
4 | 76 | וויליאמסבורג |
5 | 67 | פֿארזיכערונג |
word rank | frequency | word |
---|---|---|
1 | 59 | צוזאמענגעשטעלט |
2 | 24 | מענופעקטשערינג |
3 | 21 | קאנסערוואטיווע |
4 | 18 | קאנטערטעראריזם |
5 | 14 | קאנסערוואטיוון |
Slope |
---|
-1.185665895430997 |
Slope |
---|
-0.9595390461880369 |
Slope |
---|
-0.7751141765275469 |
Slope |
---|
-0.7385606273598312 |
Slope |
---|
-0.7781512503836436 |
Slope |
---|
null |
The validity of Zipf’s law for all words does not imply its validity for words of fixed length. The tables show the most frequent words for fixed word lengths 4, 6, 8, …, 14.
The diagram implies that Zipf’s law is still valid, at least for larger word length.
The diagrams are interesting for language comparison. In the case of a diagram of very different shape there might have been problems in preprocessing which should be visible elsewhere. Or, more interesting, there might be special features inherent to this language.
For length 8:
SELECT freq ,word FROM words WHERE w_id>100 and char_length(word)=8;
Explain why we see better agreement with Zipf’s law for larger word length.
Zipf’s law (Classic version)